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Abstract 



In a recent paper, wavelet analysis was used to perturb the coupling matrix in an array of identical 
chaotic systems in order to improve its synchronization. As the synchronization criterion is determined 
by the second smallest eigenvalue A2 of the coupling matrix, the problem is equivalent to studying how 
A2 of the coupling matrix changes with perturbation. In the aforementioned paper, a small percentage 
of the wavelet coefficients are modified. However, this result in a perturbed matrix where every element 
is modified and nonzero. The purpose of this paper is to present some results on the change of A2 due to 
perturbation. In particular, we show that as the number of systems n — > 00, perturbations which only 
add local coupling will not change A2. On the other hand, we show that there exists perturbations which 
affect an arbitrarily small percentage of matrix elements, each of which is changed by an arbitrarily small 
amount and yet can make A2 arbitrarily large. These results give conditions on what the perturbation 
should be in order to improve the synchronizability in an array of coupled chaotic systems. This analysis 
allows us to prove and explain some of the synchronization phenomena observed in a recently studied 
network where random coupling are added to a locally connected array. Finally we classify various 
classes of coupling matrices such as small world networks and scale free networks according to their 
synchronizability in the limit. 



1 Introduction 

The object of interest in this paper is a coupled array of n identical systems with linear coupling: 



where x — (xi, . . . ,x n ). The coupling matrix G describes the coupling topology of the array, i.e. Gij 7^ 
if there is a coupling between system Xi and system xj. If Gij < or Gij > 0, we call such a coupling 
element cooperative or competitive respectively. In this paper we assume that G is a symmetric zero row 
sums matrix whose off-diagonal elements are all nonpositive. This implies that all coupling is cooperative 
and all eigenvalues of G are real. The matrix D describes the coupling between a pair of systems. In 
^ 12 |3j it was shown that for a suitable D (such as D = I) , the synchronization criterion depends solely 
on the second smallest eigenvalue of G, which we denote as A2(G). In particular, the larger A 2 (G) is, the 
easier it is to synchronize the array. Furthermore, when the single uncoupled system y = f{y,t) is a chaotic 
system, A2 must necessarily be positive in order for the array to synchronize. Therefore we will equate A2 
with synchronizability in the remainder of this paper. In PQ several coupling topologies were considered. In 
particular, for nearest neighbor coupling, A2 — > as n — > 00 and thus such an array of chaotic systems will 
not synchronize for large n. 
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In 0] it was shown using wavelet analysis how a perturbed coupling matrix G = G + AG can be 
constructed such that \2{G) is much larger than A2(G) and thus the synchronizability is greatly improved. 
The perturbation AG can be thought of as the additional coupling added to the coupling array to affect its 
synchronization properties. In 4, G is obtained by modifying a small fraction (the LL\ subspace) of the 
wavelet coefficients of G. However, all of the matrix elements of G are changed in the process, i.e. AG is 
not sparse. In particular, there are no zero elements in G, the perturbed array is fully connected and every 
chaotic system is connected to every other chaotic system. To illustrate the increase of A2, in 0] the LL\ 
coefficients are multiplied by a factor of 1101. This results in a full matrix G whose off-diagonal elements 
are up to 8 times larger than the original matrix G. With such drastic changes to G, it is not surprising that 
A2 will also change dramatically. 

Note that Eq. Q has a minus sign in front of the term (G ® D)x as opposed to a plus sign in 0|. This 
means that the coupling matrix here is the negative of the coupling matrix in [I]. In other words, whereas 
0] talks about the second largest eigenvalue, we consider the second smallest eigenvalue. Writing the state 
equation as in Eq. Q has the benefit that A2 is positive (rather than negative as in 4 ). Furthermore, in this 
way, G and A2 correspond to the graph-theoretical notions of Laplacian matrix and algebraic connectivity 
respectively jS] . This is notationally less cumbersome later on when we use results from the theory of random 
graphs. 

The purpose of this paper is to attempt to answer the question of what type of matrices AG will make 
A2(G) much larger than A2(G), i.e. greatly improve the synchronizability while keeping AG "small". This 
notion of smallness could be the sparseness of AG as this refers to the number of additional coupling added 
to the original array. It could also be the size of the off-diagonal elements of AG as they relate to the coupling 
strengths between the chaotic systems in the array. We will show that there exists sparse matrices AG with 
small elements that will change A2(G) significantly. We also show that uniform coupling will increase the 
synchronizability the most. On the other hand, we show that local coupling, i.e. G corresponding to a graph 
with only local connections, will not synchronize when the number of systems is large. 

We also show how this analysis allows us to prove and explain the change in synchronizability observed 
in a coupled array where random coupling elements are added to a nearest neighbor coupled array. 

Finally we will classify several classes of coupling matrices considered in the literature according to a 
synchronizability measure, and show that the more random and less ordered the coupling graph is, the higher 
the synchronizability. 



2 Super-additivity of A2 

Definition 1 W is the class of symmetric matrices that have zero row sums and nonpositive off- diagonal 
elements. 

It can be shown that matrices in W are positive semi-definite and that is a simple eigenvalue if and only 
if the matrix is irreducible |l]. We assume that the coupling matrices G and G are in W . 

Lemma 1 If A and B are in W, then X 2 (A + B) > X 2 (A) + X 2 (B). 

Proof: see □ 
This lemma shows that Xz(G) > X 2 (G) + X 2 (AG) when AG is also a matrix in W . Therefore if we can 

find AG such that A2(AG) is large, then we can increase X 2 (G) and thus the synchronizability. 

A corollary to Lemma ^ is that if A, B are matrices in W and every off-diagonal element of A is smaller 

in absolute value than B, then X 2 (A) < X 2 (B). This means that adding additional cooperative coupling 

elements (Gjj < 0) can only increase A2 and improve the synchronizability. 

Let us consider three reasonable constraints on the possible coupling matrix G that we can choose: 

1. G G W. 

2. the number of nonzero coupling elements is a percentage of the total number of coupling elements, i.e. 
only a percentage of the off-diagonal elements of G are nonzero. 

3. the absolute value of each off-diagonal element is less than some fixed number B > 0. 
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Under these constraints, the above discussion shows that the matrix G with the largest A2 must necessarily 
be matrices in W where the off-diagonal elements are either or —B. We call such a coupling configuration 
a uniform coupling as the coupling between any pair of systems is either zero or the same 1 . Thus given a 
bound on the size of each coupling element, the uniform coupling is the best coupling configuration in terms 
of synchronizability. 

This motivates us to study the class of matrices in W where the off-diagonal elements is either or -1. 
Such a matrix is the Laplacian matrix of the underlying graph: vertex i is connected to vertex j if and only 
if Gij ^ and A2 corresponds to the algebraic connectivity of the graph [B]. This allows us to use results 
in graph theory to study A2(G). In particular, in the rest of the paper, we will mainly consider coupling 
matrices which is a positive multiple of the Laplacian matrix of the underlying graph and the goal is to find 
appropriate coupling graphs whose algebraic connectivity are large. 

3 Local coupling 

Consider the following model of local coupling [7]: let the vertices of the coupling graph be the points in 
the hypercube [0, r] d with integer coordinates, i.e. the vertices are the lattice points inside the hypercube 
[0,r] d generated by the standard basis vectors. Let the systems in the array be located on these vertices. 
We say this array is locally connected if there exists a fixed S such that all the systems which are connected 
to each system x lies in the ^-neighborhood of x. This notion of local coupling includes examples such as 
nearest neighbor coupling and grid graphs, but also more general local coupling configurations where the 
vertex degree is bounded but not necessarily constant. 
In it was shown that: 

Lemma 2 For fixed d and 8, a locally connected array will have A2 — > as n — ► 00 (i.e. r — > 00). This is 
true even if the hypercube is considered as a hypertorus. 

This means that locally connected arrays will have low synchronizability for large n. In particular, 
locally connected arrays of chaotic systems will not synchronize for large n. This means that AG should 
have nonlocal coupling in order to improve the synchronizability of the array. Next we show that random 
coupling is some sense the best candidate for such nonlocal coupling. 

4 Random coupling 

How much coupling do we need to add in order to make A2 large while keeping the size of the off-diagonal 
element small? In [H] it was shown that: 

Lemma 3 For a non-complete graph A2 is less than or equal to the minimum vertex degree 2 . 

In particular, for a fc-regular (non-complete) graph, A2 < k. Therefore, if we want A2 to be large we need 
each vertex to connect to a large number of other vertices, i.e. AG cannot be too sparse. Regular random 
graphs appear to be asymptotically optimal in this respect by Lemma [21 and the following lemma. 

Lemma 4 There exists a constant < c < 1 such that almost every k-regular random graph satisfies A2 > ck 
as n — ► 00 for large enough k. For even k, c can be chosen close to 1. 

Proof: See [7]. □ 
For small k, it can be shown that for k > 3, there is a constant cj, > such that almost every fc-regular 
random graph satisfies A2 > Ck as n — > 00. In particular, since A2 > k — \Jk 2 — i 2 [HI E] where i is the 
isoperimetric number of the graph, and using the results in j2J, a graph of Ck for k between 3 and 15 is shown 
in Figure CI 

This allows us to prove the following theorem which says that there is an n by n coupling matrix AG 
with an arbitrarily small percentage of nonzero off-diagonal elements, each of which is arbitrarily small, and 
which has arbitrarily large A2 when n is large enough. 

1 This notion of uniform coupling is different than the notion used by some authors to denote fully connected coupling. 
2 For a complete graph, \2(K n ) = n. 
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Figure 1: Plot of lower bound Ck of the second smallest eigenvalue of fc-regular random graphs for 3 < k < 15. 

Theorem 1 Given < p < 1, r > 0, and s, for all large enough n, there exists a matrix AG in W such 
that 

• A 2 > s, 

• the fraction of nonzero elements of AG is p, 

• each off-diagonal element of AG is less than r. 

Proof: Choose fc an integer larger than — . By Lemma 0] for large enough n and fc, almost every random 
fc-regular graph will have A 2 > ^ . Choose large n such that n > | . Let A be the Laplacian matrix of such 
a graph. Then AG = rA will suffice. □ 

So far, the random graph corresponding to AG is required to be a regular graph. Next we show that this 
requirement can be relaxed. In a network model is presented where a nearest neighbor configuration is 
modified by adding a fraction < p < 1 of random edges out of all possible edges 3 . In ^H) it was shown via 
numerical experiments that A 2 (G) increases in a near linear fashion with respect to p and to n. We prove 
that this is true in general. Let G be a locally connected graph and AG is constructed as in ^U] by picking 
randomly a fraction p of all possible edges. 

First note that by Lemmas and A 2 (G) < pn + q where q is the average number of connections of G. 
In ^21 it was shown that A 2 (AG) is equal to pn + o(n? +e ) in probability for any e > 0. Combining this with 
Lemmas n an d El it's clear that A 2 (G) increases as o(pn) in probability as n — > 00, i.e. linear in p and in n. 

Thus in general, given a locally connected array, the addition of a fraction of random edges out of all 
possible edges will increase the synchronizability by an arbitrarily large amount as the number of vertices 
increases. Note that the synchronizability of the random edges dominates that of the locally connected 
graph. 

3 The authors of 1101 erroneously associated this model with the small world model in 1111 . In 1111 the number of added 
edges is a fraction p of the existing edges in the nearest neighbor coupling. Therefore the number of edges in 1111 is much less. 
In particular, for p = 1, the graph in [10* is fully connected, whereas in 1111 the number of edges is only twice the number of 
edges of the nearest coupling graph. In particular for the one-dimensional nearest neighbor coupling, by Lemma|2]the algebraic 
connectivity of the model in 1111 is at most 2, whereas it is unbounded in 1101 as n — » 00. 
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4.1 Example 

To compare the results in this section with the results in 0] , consider the example in |3] that was discussed 
in Section^where an array of 64 oscillators with nearest neighbour coupling is perturbed by multiplying the 
LLi wavelet coefficients of the coupling matrix G by a factor of 1101. This increases A2 from 0.0096 to 0.1522. 
However, all entries of the 64 by 64 matrix G are changed, with the off-diagonal entries of the perturbation 
matrix AG ranging from —7.6 to 9.7. On the other hand, suppose we want to change only 5 percent of 
the off-diagonal entries of G. By choosing a random graph with 100 edges and corresponding Laplacian 
matrix L, we construct a perturbation matrix AG = 0.0665L which also increases A2 from 0.0096 to 0.1522. 
However, in this case, only 5 percent of the off-diagonal entries of G are perturbed, and the off-diagonal 
entries of the perturbation matrix AG is either —0.0665 or 0. Thus the improvement in synchronization is 
the same as in g], but the perturbation matrix is much smaller, both in the sense of the number of nonzero 
elements and in the sense of the magnitude of the nonzero elements. 

5 Comparison of various classes of coupling graphs 

In this section we compare several classes of coupling graphs that have been proposed in the literature 
for modeling complex networks, both man-made (the internet or social networks) and occuring in nature 
(neural networks). We can categorize their synchronizability by studying the synchronizability measure 
s(m) = lim n — »oo when it exists, where m is the average number of connections defined as 2 times the 
number of edges divided by the number of vertices, i.e. m is the number of nonzero off-diagonal elements of 
the Laplacian matrix divided by n. For r-regular graphs, m = r. By Lemma|31 < s(m) < 1. We will only 
consider the cases m > 3. 

5.1 Small world networks 

In j 1 1 1 a small-world network model is introduced where starting from a locally connected graph with m 
edges, pm edges (0 < p < 1) are added randomly. Without the random edges A2 — * as n — + 00 by Lemma 
121 In the cases considered in m grows linearly with n, i.e. m = kn. If we modified this model such that 
the added random edges form a regular random graph 4 , then the discussion in Section 0] shows that A2 is 
bounded away from zero as n — * 00 when kp > |. In particular, Figure ^ shows that s(m) > 0.0018. Thus 
by adding the random edges, there is a coupling strength factor e > such that when D is replaced by eD, 
the coupled array will synchronize independent of n. 

5.2 Scale-free random networks 

In ^21 a scale- free random network model of the internet is presented where the graph is built up as follows: 
Starting from a initial set of ka (usually set at fco = k) vertices, at each iteration a new vertex is added 
with k new edges connecting this vertex to k existing vertices. Thus the average connections is m = 2k as 
n — > 00. The probability that the new vertex is connected to vertex i is proportional to the vertex degree of 
vertex i. This results in a graph whose vertex degree distribution follows a power law. Since there is always 
at least one vertex with degree k, A 2 < k and s(m) < | by Lemma 01 Computer simulations 5 show that 
for a fixed m, A2 of such graphs appear to increase monotonically as a function of n. If this is the case, 
then since A2 is bounded by y, this means that A2 converges to a constant value A 2 x> (m) as n — > 00. We 

computed via simulations the value of s(m) = * 2 for various m as shown in Figure|21 We see that s(m) 
is increasing and converging to close to the upper bound | . As the scale- free network is not as random as a 
random network, its synchronizability measure is also less. 

4 This requires that 2kp is an integer. 

5 We differ slightly from 1131 in our construction of the scale-free networks. In 1131 the initial configuration is fco vertices 
with no edges. After many iterations, this could still result in some of these initial fco vertices having degree less than fc, even 
though every newly added vertex has degree at least fc. Since even one vertex with degree 1 results in A2 to drop below 1, we 
would like to have every vertex of the graph to have degree at least fc. Therefore we will start with the initial fco vertices fully 
connected to each other when fco = fc. For the case fco > fc, we require that the initial fco vertices are connected with each other 
with vertex degrees at least fc. This will guarantee that the vertex degree of every vertex is at least fc. 
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Figure 2: Plot of the synchronizability measure s(m) for scale free random networks. We see that s(m) is 
increasing and approaches close to the upper bound i 



Graph class 


Synchronizability measure s(m) 


Locally connected graphs [7] 





Scale-free networks 13 


« 0.5 as m — > oo 


Small world networks HU 


> 0.0018, wlasm^oo 


Model in 10 


s(m) w 1, A2 — > 00 as n — » 00 



Table 1: Several classes of coupling graphs and their synchronizability measure s(m). 



For locally connected graphs, s(m) = for all m by Lemma |21 For both small- world networks and the 
model in |l()j s(m) ~ 1 for large m. The main difference is that in small-world networks, m (and thus 
also A2) is small and bounded, whereas in |10|. m = pn and therefore A2 is unbounded. These results are 
summarized in Tabled 

Thus we can order these classes of matrices as follows in terms of increasing synchronizability: locally 
connected graphs, scale- free networks, small- world networks, and the model in |1()| . We see that the more 
disorder and randomness the graph exhibits, the higher the synchronizability. 

6 Conclusions 

We study the conditions under which perturbation of the coupling in a coupled array results in improved 
synchronizability by reducing it to the analysis of the second smallest eigenvalue of the coupling matrix. We 
show that local coupling and random coupling form two extremes in their effect on synchronizability. In 
particular, local coupling will not improve synchronizability in the limit and random coupling can change 
the synchronizability using arbitrarily small percentage of coupling elements whose strengths are arbitrar- 
ily small. As graphs become less ordered and more random, we see that the synchronizability increases. 
Furthermore, for graphs which is constructed by adding a random component to a structured component, 
the super-additivity of A2 allows us to give a lower bound for the synchronizability of graphs by adding 
the synchronizability of each of the components. In particular, when the structured component is a locally 



G 



connected graph, the synchronizability of the random component dominates the synchronizability of the 
locally connected component. 
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